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Method for initiating occupant-assisted measures inside a vehicle 

The invention relates to a method for initiating occupant-assisted measures 
inside a vehicle. 

From DE 198 01 009 CI, a method is known wherein an emergency or 
stress situation of the driver of a vehicle is detected and a device for initia- 
tion or performing a braking process is actuated for support. In doing so, 
the emergency or stress situation of the driver is detected with the aid of 
sensors provided to detect a change of the blood pressure and/or a change 
of the pulse and/or a change of the pupil and/or a change of the facial ex- 
pression and/or a change of the eyelid reflex and/or a muscular contraction, 
preferably a muscular contraction of the hand, and/or a change of the skin 
resistance and/or a change of the sweat secretion. 

The time duration up to the generation of one of the above mentioned 
physical reactions on an emergency or stress situation perceived by the 
driver will cause a delay in the supportive initiation of the braking process, 
which may be disadvantageous. 

Further, from DE 197 02 748 Al, it is known to detect the condition of the 
conductor of a vehicle, e.g. of a train, by monitoring, for instance, the cere- 
bral currents of the conductor. 

It is an object of the invention to provide a method for initiating occupant- 
assisted measures inside a vehicle wherein the time span between the gen- 
eration of the intention e.g. of the driver of the vehicle and the to-be- 
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initiated measure is abbreviated and the measure can thus be initiated vir- 
tually without time delay. 

According to the invention, to achieve the above object, there is proposed a 
method for initiating occupant-assisted measures inside a vehicle wherein 
cerebral-current signals of at least one vehicle occupant, particularly of 
the driver, are detected by a measurement technique, 
on the basis of the cerebral-current signals, the intention of the vehicle 
occupant is estimated or detected by real-time processing, and 
on the basis of the intention of the vehicle occupant, measures for 
transferring the current state of the vehicle into a state of the vehicle 
matched to the intention of the vehicle occupant are initiated in ad- 
vance. 

Advantageous embodiments of the invention are indicated in the subclaims. 

According to the invention, the action-specific intentions of the occupants 
and the driver, respectively, are detected on the basis of their cerebral cur- 
rents. This is performed at the earliest possible point of time so that delays 
which might occur e.g. up to the generation of secondary reactions of the 
body, will be avoided- Further, also intentions which do not cause secondary 
reactions of the body can be detected. For instance, on the basis of the 
cerebral currents, it can be detected in what manner the driver intends to 
steer the vehicle, thus allowing for optimum preparation of vehicle stabiliza- 
tion systems in accordance with the type of the steering maneuver. 

Thus, according to the invention, there is proposed a method for use in ve- 
hicles in order to provide an improved driver/vehicle interface by evaluation 
of cerebral currents, e.g. by EEG, MEG, NIRS, fMRI and/or EMG. 

The method according to the invention has the property, inter alia, that the 
driver's attitude in a very general sense and, especially, the driver's reac- 
tion errors and reaction delays are detected and analyzed and thus, as a 



novel multi-purpose feature for improved vehicle safety, will be available to 
be inputted into a safety system arranged downstream. The method can be 
used in a vehicle, inter alia, for the purposes of 

1. accident-preventive safety measures such as 

a) automatic safety belt tightening 

b) seat optimization 

c) optimization of the vehicle reagibility to prepare a braking/steering 
operation 

d) pre-optimization of the vehicle dynamics in case of time-critical 
decisions 

e) all predicative safety measures. 

2. driver-based verification of device-detected hazardous situations such 
as, e.g. 

a) detection of a congruent motor generation of an intention 

b) situation modeling and validating. 

3. continuous vigilance monitoring. 

The invention, its foundations and principal ideas will be described in 
greater detail hereunder. 

The invention allows for a basically novel quality of man/machine interfaces 
by the combination of cerebro-physiological findings and algorithmic devel- 
opments in the field of information technology, notably in that the concept 
of a direct transformation of cerebral signals into machine-related control 
commands is realized in a brain/computer interface (BCI) as a real-time 
implementation. As a non-invasive measurement method which in principle 
is suited for everyday applications, use is made e.g. of the multi-channel 
EEG with a time resolution in the milliseconds range. The methodological 
approach is based on robust algorithms of machine learning and signal 
processing for extraction, identification and classification of EEG cerebral 



signals which represent intentions of natural motions in psychophysiologic 
cally well-defined interaction situations between humans and the environ- 
ment. A further characteristic feature of the BBCI used here resides in the 
adaptation to a training situation optimized for the user; in this training 
situation, in contrast to other BCI methods, the user does not need to un- 
dergo several training sessions but merely one about 20-minute-long train- 
ing phase to thus obtain starting material for the learning algorithm (cf. 
Blankertz, B., Curio, G., Muller, K.-R. (2003), Classifying Single Trial EEG: 
Towards Brain Computer Interfacing, Advances in Neural Information Proc- 
essing Systems 14, eds. T.G. Dietterich, S. Becker and Z. Ghahramani, MIT 
Press: Cambridge, MA, 157-164; Dornhege, G., Blankertz, B., Curio, G., 
Muller, K.-R., Combining Features for BCI, Advances in Neural Information 
Processing Systems 15, eds. S. Becker, S. Thrun and K. Obermayer, MIT 
Press: Cambridge, MA (2003)). 

For a BCI, well-defined application perspectives for clinical use in paralyzed 
patients do already exist on an international level, particularly for cases of 
complete paraplegia. The invention for the first time opens up the possibil- 
ity, in time-critical real-time applications as typically existing e.g. in 
driver/vehicle interfaces, to realize novel methodical approaches: 

1. In the psychophysiological research for detection and handling of reac- 
tion errors and reaction delays of the driver, it is now for the first time 
possible, both in virtual driving simulations and in real driving situa- 
tions, to detect the motor reaction intentions of the driver with high 
time resolution in the millisecond range as non-averaged individual re- 
sults and thereby analyze them in dependence on the currently varying 
perceptual context (multi-modal environment information as well as 
instrument signals). 

2. When used as a driver assistance system, concepts of "integrated 
safety" can be enriched by novel components for a continuously pro- 
ceeding ("on-the-fly") driver modeling: 



a) Due to the BBCI real-time suitability, the EEG correlatives - identi- 
fiable as individual events - of intention generation and specific 
motion preparations can serve as a novel input value for concepts 
of accident-preventive safety, e.g., in automobiles, for the pur- 
poses of motor-powered safety belt tightening, seat optimization or 
optimization of the vehicle reagibility in order to prepare a brak- 
ing/steering operation. 

b) Moreover, a quickest possible driver-based "verification" of the re- 
alization of hazards can be performed in a machine-operated (e.g. 
optical) manner by detection of a congruent motor intention build- 
up of the driver, allowing for a correspondingly validated situation 
modeling. 

c) Particularly, time-critical decision alternatives such as e.g. a- 
choice, dictated by the situation, between an emergency braking 
maneuver and a well -steered dodging maneuver which are legally 
left to the driver's discretion, can be prognosticated already tenths 
of seconds before the actual reaction motion of the driver by ex- 
tracting the corresponding motor intentions from the EEG signal of 
the driver and utilizing them for the purposes of a pre-optimization 
of the vehicle dynamics. 

As an additive advantage offered by this EEG-based BCI approach, mention 
should be made of the farther-reaching multi-purpose feature that these 
EEG data, apart from the novel applications defined here, also allow for a 
seamless integration of concepts for continuous driver vigilance monitoring 
which were established already in the past. 



